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TITLE OF THE INVENTION 

MOBILE COMMUNICATION SYSTEM, MOBILE COMMUNICATION 
TERMINAL AND PROGRAM THEREOF 
BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to mobile 

communication systems, mobile communication terminals 
and programs thereof. More particularly, the present 
invention relates to mobile communication systems, 
mobile communication terminals and programs which 
provide navigation service to the user of the mobile 
communication terminal by using video. 
Related Background of the Invention 

[0002] Technologies in such field include a 

various types of navigation apparatuses. One type of 
such navigation apparatuses is a navigation apparatus 
in which a video acquired by a camera, which is 
associated with specified points, such as 
intersections, on a map, are pre-stored and the video 
associated with the points on the map are displayed on 
the basis of position information acquired by GPS 

(Global Positioning System) (e.g. Japanese Patent 
Application Laid-open No. 2000-304559) . Namely, this 
navigation apparatus provides route guidance service by 
displaying a video photographed around the current 
position thereof. 



SUMMARY OF THE INVENTION 

[0003] However, since the above-described 

navigation apparatus associates the video with specific 
points, such as intersections, on the map, the video is 
5 associated with coarse position information. 

Accordingly, at actual positions of the apparatus, a 
video which are different from the scenes around the 
positions are displayed, which is problematic. 
[0004] The present invention, for solving the 

10 above problem, provides mobile communication system, 

mobile communication terminals and programs capable of 
displaying a video of scenes at desired positions. 
[0005] In order to solve the above problem, a 

mobile communication system of the present invention 

15 comprises a first mobile communication terminal and a 

second communication terminal. The first mobile 

communication terminal comprises: first position 
information acquiring means for acquiring position 
information; photographing means for acquiring images 

20 of field; position information assigning means for 

associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 
acquired by the first position information acquiring 

25 means and specifies the position at which the image, is 

acquired; video generating means for generating a video 
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including frames each associated with the position 
information concerning the acquired position, based on 
a plurality of images which are photographed by the 
photographing means and include the images each 
5 associated with the position information by the 

position information assigning means; storage means for 
storing the video generated by the video generating 
means and items of the position information which are 
associated with the frames included in the video; and 

10 transmitting means for transmitting the video and the 

items of position information associated with the 
frames included in the video, which are stored in the 
storage means. The second mobile communication 

terminal comprises: receiving means for receiving the 

15 video and items of the position information associated 

with the frames of the video which are transmitted from 
the first mobile communication terminal; second 
position information acquiring means for acquiring 
position information; searching means for specifying, 

20 among the position information received by the 

receiving means, the position information corresponding 
to the position information acquired by the second 
position information acquiring means to specify the 
frame of the video associated with the specified 

25 position information; and playback means for displaying 

the frame of the video specified by the searching 
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means . 

[0006] Further , a mobile communication terminal of 

the present invention corresponds to the first mobile 
communication terminal of the mobile communication 
system according to the above-described invention. The 
mobile communication terminal comprises: position 
information acquiring means for acquiring position 
information;, photographing means for acquiring images 
of field; position information assigning means for 
associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 
acquired by the position information acquiring means 
and specifies the position at which the image is 
acquired; video generating means for generating a video 
including frames each associated with the position 
information concerning the acquired position, based on 
a plurality of images which are photographed by the 
photographing means and include the images each 
associated with the position information by the 
position information assigning means; storage means for 
storing the video generated by the video generating 
means and items of the position information which are 
associated with the frames included in the video; and 
transmitting means for transmitting the video and the 
items of position information associated with the 
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frames included in the video, which are stored in the 
storage means, 

[0007] Further, a mobile communication terminal of 

the present invention corresponds to the second mobile 
5 communication, terminal of the mobile communication 

system according to the above-described invention. The 
mobile communication terminal comprises: receiving 
means for receiving a video which includes frames each 
associated with position information for specifying the 

10 acquired position, and items of the position 

information; position information acquiring means for 
acquiring position information; searching means for 
specifying, among the items of position information 
received by the receiving means, the position 

15 information corresponding to the position information 

acquired by the position information acquiring means to 
specify the frame of the video associated with the 
specified position information; and playback means for 
displaying the frame of the video specified by the 

20 searching means. 

[0008] In accordance with the inventions, the 

mobile communication system comprises the first mobile 
communication terminal and the second mobile 
communication terminal. In the first mobile 

25 communication terminal, each images acquired by the 

photographing means in a predetermined time interval is 
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associated with position information concerning the 
position at which the image is acquired. Then, the 
video generating means generates, from a plurality of 
images including images each associated with the 
position information, a video including frames each 
associated with the position information. The video is 
transmitted by the transmitting means to the second 
mobile communication terminal. In the second mobile 
communication terminal, the playback means displays the 
frame associated with the position information 
corresponding to the position information acquired by 
the second position information acquiring means. Thus, 
in the first mobile communication terminal, the video 
including frames each associated with the position 
information concerning the position at which the frame 
is acquired. Therefore, the first mobile communication 
terminal can generate a video including frames each 
associated with position information, which is little 
deviated from the position at which the frame is 
acquired. Further, in the second mobile communication 
terminal, a frame specified on the basis of position 
information acquired by the second position information 
acquiring means is displayed. Therefore, the second 
mobile communication terminal can display, at a current 
position thereof, a video concerning the scene 
neighboring the position. 



[0009] In order to solve the above problem, a 

mobile communication system of the present invention 
comprises a first mobile communication terminal and a 
second mobile communication terminal. The first mobile 
communication terminal comprises: first position 
information acquiring means for acquiring position 
information; photographing means for acquiring images 
of field; position information assigning means for 
associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 
acquired by the first position information acquiring 
means and specifies the position at which the image is 
acquired; video generating means for generating a video 
including frames each associated with the position 
information concerning the acquired position, based on 
a plurality of images which are photographed by the 
photographing means and include the images each 
associated with the position information by the 
position information assigning means; storage means for 
storing the video generated by the video generating 
means and items of the position information which are 
associated with the frames included in the video; and 
transmitting means for transmitting the video and the 
items of position information associated with the 
frames included in the video, which are stored in the 



storage means. The second mobile communication 

terminal comprises: receiving means for receiving the 
video and items of the position information associated 
with the frames of the video which are transmitted from 
the first mobile communication terminal; playback means 
for displaying the video received by the receiving 
means; and map display means for displaying two- 
dimensional map information and displaying, by 
superimposing on the two-dimensional map information, a 
travel locus based on the items of position information 
associated with the frames of the video displayed by 
the playback means. 

[0010] Further, a mobile communication terminal of 

the present invention corresponds to the second mobile 
communication terminal of the mobile communication 
system according to the above-described invention. The 
mobile communication terminal comprises: receiving 
means for receiving a video which includes frames each 
associated with position information for specifying the 
acquired position, and items of the position 
information; playback means for displaying the video 
received by the receiving means; and map display means 
for displaying two-dimensional map information and 
displaying, by superimposing on the two-dimensional map 
information, a travel locus based on the items of 
position information associated with the frames of the 
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video displayed by the playback means. 

[0011] In accordance with the above inventions, 

the mobile communication system comprises a first 
mobile communication terminal and a second mobile 
communication terminal. In the first mobile 

communication terminal, each images acquired by the 
photographing means in a predetermined time interval is 
associated with position information concerning the 
position at which the image is acquired. Then, the 
video generating means generates, from a plurality of 
images including images each associated with position 
information, a video including frames each associated 
with position information. The video is transmitted by 
the transmitting means to the second mobile 
communication terminal. In the second mobile 

communication terminal, the playback means displays the 
video, and the map display means displays two- 
dimensional map information and a travel locus 
superimposed thereon, the travel locus being based on 
items of the position information associated with the 
frames being displayed. Therefore, the first mobile 
communication terminal can generate a video including 
frames each associated with position information, which 
is little deviated from the position at which the frame 
is acquired. Further, in the second mobile 

communication terminal, the map display means displays, 



by superimposing onto two-dimensional map information, 
a travel locus based on the items of position 
information associated with the frames being displayed. 
Therefore, the second mobile communication terminal can 
5 provide information concerning position on two- 

dimensional map and a video of scenes around the 
position. 

[0012] In order to solve the above problem, a 

mobile communication terminal of the present invention 

10 comprises: position information acquiring means for 

acquiring position information; photographing means for 
acquiring images of field; position information 
assigning means for associating each of the images, 
which are acquired by the photographing means in a 

15 predetermined time interval, with the position 

information which is acquired by the position 
information acquiring means and specifies the position 
at which the image is acquired; video generating means 
for generating a video including frames each associated 

20 with the position information concerning the acquired 

position, based on a plurality of images which are 
photographed by the photographing means and include the 
images each associated with the position information by 
the position information assigning means; storage means 

25 for storing the video generated by the video generating 

means and items of the position information which are 
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associated with the frames included in the video; 
searching jitieans for specifying, among the items of 
position information stored in the storage means, the 
position information corresponding to the position 
information acquired by the position information 
acquiring means to specify the frame of the video 
associated with the specified position information; and 
playback means for displaying the frame of the vide.o 
specified by the searching means. 

[0013] In the mobile communication terminal 

according to this invention, each images acquired by 
the photographing means in a predetermined time 
interval is associated with position information 
concerning the position at which the image is acquired. 
Then, the video generating means generates, from a 
plurality of images including images each associated 
with the position information, a video including frames 
each associated with the position information. Then, 
the playback means displays the frame of the video 
associated with the position information acquired by 
the position information acquiring means. Thus, the 
mobile communication terminal according to the present 
invention is capable of generating a video including 
frames each associated with the position information, 
which is little deviated from the position at which the 
frame is acquired. Further, the mobile communication 
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terminal according to the present invention can display 
frame specified on the basis of position information 
acquired by the position information acquiring means 
and therefore can display, at a current position 
5 thereof, a video concerning the scenes neighboring the 

position. 

[0014] In order to solve the above problem, a 

mobile communication terminal of the present invention 
comprises: position information acquiring means for 

10 acquiring position information; photographing means for 

acquiring images of field; position information 
assigning means for associating each of the images, 
which are acquired by the photographing means in a 
predetermined time interval, with the position 

15 information which is acquired by the position 

information acquiring means and specifies the position 
at which the image is acquired; video generating means 
for generating a video including frames each associated 
with the position information concerning the acquired 

20 position, based on a plurality of images which are 

photographed by the photographing means and include the 
images each associated with the position information by 
the position information assigning means; storage means 
for storing the video generated by the video generating 

25 means and items of the position information which are 

associated with the frames included in the video; 

12 



playback means for displaying the video stored in the 
storage means; and map display means for displaying 
two-dimensional map information and displaying, by 
superimposing onto the two-dimensional map information, 
5 a travel locus based on the position information 

associated with frames of the video displayed by the 
playback means. 

[0015] In the mobile communication terminal 

according to this invention, each images acquired by 

10 the photographing means in a predetermined time 

interval is associated with position information 
concerning the position at which the image is acquired. 
Then, the video generating means generates, from a 
plurality of images including images each associated 

15 with the position information, a video including frames 

each associated with the position information. Then, 
the playback means displays the video and the map 
display means displays, by superimposing onto two- 
dimensional map information, a travel locus based on 

20 items of the position information associated with 

frames of the video being played back. Thus, the 
present invention provides a mobile communication 
terminal capable of generating a video including frames 
each associated with the position information which is 

25 little deviated from the position at which the frame is 

acquired. Further, since the map display means 
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displays, by superimposing onto two-dimensional map 
information, a travel locus based on the items of 
position information associated with frames of a video 
being displayed by the playback means, this mobile 
communication terminal can provide information 
concerning position on a two-dimensional map and a 
video concerning the scenes around the position to the 
user. 

[0016] Preferably, the abovementioned mobile 

communication terminals provided with the video 
generating means further comprises a frame rate 
adjusting means. The frame rate adjusting means 
adjusts the frame rate of the video, based on a 
plurality of images acquired by the photographing means 
including the images each associated with the position 
information by the position information assigning 
means. The frame rate adjusting means rate adjusting 
means divides the plurality of images into a plurality 
of groups including a predetermined number of images 
based on the order in which the images are acquired. 
The frame rate adjusting means determines, for each of 
the groups, direction information indicating the 
direction of a travel locus based on the position 
information associated with the predetermined number of 
images in the corresponding group. The frame rate 
adjusting means sets, for each of the groups, a frame 



rate for the video based on the predetermined number of 
images in the corresponding group to a first frame rate 
when a direction change amount based on the direction 
information determined for the corresponding group and 
the direction information determined for at least one 
of the previous group and the next group is larger than 
a predetermined amount, and sets the frame rate to a 
second frame rate lower than the first frame rate when 
the direction change amount is equal to or smaller than 
the predetermined amount. Further, the video 

generating means generates the video using the 
plurality of images, according to the frame rate 
determined for each of the plurality of groups. 
[0017] In the mobile communication terminal 

structured as above, if there is no large direction 
change around the photographed position on the basis of 
the travel locus, the frame rate adjusting means sets a 
low frame rate for the video to be generated from 
images acquired around this position. Thus, the mobile 
communication terminal can generate a video having a 
low frame rate for areas including no large direction 
change and therefore no significant change in scenes 
within the field, thereby having reduced capacities. 
[0018] Preferably, a mobile communication terminal 

provided with the video generating means further 
comprises second transmitting means and receiving 
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means. The second transmitting means transmits the 
video generated by the video generating means and the 
items of position information associated with the 
frames of the video to a server. The server is a 
5 server which adjusts a frame rate of the video 

generated by the video generating means. The server 
divides the plurality of images included in the video 
into a plurality of groups including a predetermined 
number of images based on the order in which the images 

10 are acquired, and determine, for each of the groups, 

direction information indicating the direction of a 
travel locus based on the position information 
associated with the predetermined number of images in 
the corresponding group. The server further changes, 

15 for each of the groups, a frame rate of the video based 

on the predetermined number of images in the 
corresponding group to a first frame rate when a 
direction change amount based on the direction 
information determined for the corresponding group and 

20 the direction information determined for at least one 

of the previous group and the next group is larger than 
a predetermined amount, and changes the frame rate of 
the video to a second frame rate lower than the first 
frame rate when the direction change amount is equal to 

2 5 or smaller than the predetermined amount. The 

receiving means receives the video with frame rates 
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adjusted by the server and the items of position 
information associated with frames of the video, and 
then stores the video and the items of position 
information in the storage means. 

[0019] In the mobile communication terminal 

structured as above, the second transmitting means 
transmits to the server a video and the position 
information associated therewith, and then receives the 
video of which frame rates are adjusted by the server. 
The server sets, for sections in which there is no 
large direction change based on the travel locus around 
the positions at which images are acquired, a low frame 
rate for the video of the positions. Thus, the mobile 
communication terminal structured as above can generate 
a video having a low frame rate for sections including 
no large direction change and therefore no significant 
change in scenes within the field, thereby having 
reduced capacities. 

[0020] Preferably, in the mobile communication 

terminal in which the video is displayed, the playback 
means refers to a travel locus based on the position 
information associated with frames of the video and 
displays a symbol indicating the direction of travel 
based on the travel locus. 

[0021] The mobile communication terminal 

structured as above superimposes, onto a video, a 



predetermined symbol indicating the direction of 
travel, and therefore can provide convenient route 
guidance service to the user of the mobile 
communication terminal . 

[0022] In order to solve the above problem, a 

program according to the present invention causes a 
mobile communication terminal to operate as: position 
information acquiring means for acquiring position 
information; photographing means for acquiring images 
of field; position information assigning means for 
associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 
acquired by the position information acquiring means 
and specifies the position at which the image is 
acquired; video generating means for generating a video 
including frames each associated with the position 
information concerning the acquired position, based on 
a plurality of images which are photographed by the 
photographing means and include the images each 
associated with the position information by the 
position information assigning means and for storing 
the video and items of the position information 
associated with the frames of the video in a storage 
means; and transmitting means for transmitting the 
video and the items of position information associated 
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with the frames included in the video, which are stored 
in the storage means. 

[0023] The program structured as above causes a 

mobile communication terminal to operate as the 
position information acquiring means, the photographing 
means, the position information assigning means, the 
video generating means and the transmitting means as 
described above. Therefore, the mobile communication 
terminal, which is operated according to the program, 
can generate a video including frames each associated 
with position information, which is little deviated 
from the position at which the frame is acquired. 
[0024] In order to solve the above problem, a 

program according to the present invention causes a 
mobile communication terminal to operate as: receiving 
means for receiving a video which includes frames each 
associated with position information for specifying the 
acquired position, and items of the position 
information; position information acquiring means for 
acquiring position information; searching means for 
specifying, among the items of position information 
received by the receiving means, the position 
information corresponding to the position information 
acquired by the position information acquiring means to 
specify the frame of the video associated with the 
specified position information; and playback means for 



displaying the frame of the video specified by the 
searching means* 

[0025] The program structured as above causes a 

mobile communication terminal to operate as the 
receiving means, the position information acquiring 
means, the searching means and the playback means as 
described above. Therefore, the mobile communication 
terminal which is operated according to the program can 
displays, at its current position, a video concerning 
the scenes neighboring the position. 

[0026] In order to solve the above problem, a 

program according to the present invention causes a 
mobile communication terminal to operate as: receiving 
means for receiving a video which includes frames each 
associated with position information for specifying the 
acquired position, and items of the position 
information; playback means for displaying the video 
received by the receiving means; and map display means 
for displaying two-dimensional map information and 
displaying, by superimposing on the two-dimensional map 
information, a travel locus based on the items of 
position information associated with the frames of the 
video displayed by the playback means. 

[0027] The program structured as above causes a 

mobile communication terminal to operate as the 
receiving means, the playback means and the map display 



means as described above. Therefore, the mobile 
communication terminal, which is operated according to 
the program, can provide information concerning 
position on a two-dimensional map and a video of scenes 
5 around the position. 

[0028] In order to solve the above problem, a 

program according to the present invention causes a 
mobile communication terminal to operate as: position 
information acquiring means for acquiring position 

10 information; photographing means for acquiring images 

of field; position information assigning means for 
associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 

15 acquired by the position information acquiring means 

and specifies the position at which the image is 
acquired; video generating means for generating a video 
including frames each associated with the position 
information concerning the acquired position, based on 

20 a plurality of images which are photographed by the 

photographing means and include the images each 
associated with the position information by the 
position information assigning means, and for storing 
the video and items of the position information 

25 associated with the frames of the video in a storage 

means; searching means for specifying, among the items 
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of position information stored in the storage means, 
the position information corresponding to the position 
information acquired by the position information 
acquiring means to specify the frame of the video 
associated with the specified position information; and 
playback means for displaying the frame of the video 
specified by the searching means. 

[0029] The program structured as above causes a 

mobile communication terminal to operate as the 
position information acquiring means, the photographing 
means, the position information assigning means, the 
video generating means, and the searching means and the 
playback means as described above. Therefore, the 
mobile communication terminal, which is operated 
according to the program, can generate a video 
including frames each associated with position 
information, which is little deviated from the position 
at which the frame is acquired. The mobile 

communication terminal which is operated according to 
the program can also display, at its current position, 
a video concerning the scenes neighboring the position. 
[0030] In order to solve the above problem, a 

program according to the present invention causes a 
mobile communication terminal to operate as: position 
information acquiring means for acquiring position 
information; photographing means for acquiring images 



of field; position information assigning means for 
associating each of the images, which are acquired by 
the photographing means in a predetermined time 
interval, with the position information which is 
acquired by the position information acquiring means 
and specifies the position at which the image is 
acquired; video generating means for generating a video 
including frames each associated with the position 
information concerning the acquired position, based on 
a plurality of images which are photographed by the 
photographing means and include the images each 
associated with the position information by the 
position information assigning means, and for storing 
the video and items of the position information 
associated with the frames of the video in a storage 
means; playback means for displaying the video stored 
in the storage means; and map display means for 
displaying two-dimensional map information and 
displaying, by superimposing onto the two-dimensional 
map information, a travel locus based on the position 
information associated with respective frames of the 
video being displayed by the playback means. 
[0031] The program structured as above causes a 

mobile communication terminal to operate as the 
position information acquiring means, the photographing 
means, the position information assigning means, the 



video generating means, the playback means and the map 
display means as described above. Therefore, the 
mobile communication terminal, which is operated 
according to the program, can generate a video 
5 including frames each associated with position 

information, which is little deviated from the position 
at which the frame is acquired. The mobile 

communication terminal which is operated according to 
the program can also display, on two-dimensional map 

10 information, a travel locus based on the position 

information each associated with the frame of the video 
by the map display means, and therefore can provide 
information concerning position on a two-dimensional 
map and a video concerning the scenes around the 

15 position. 

[0032] The present invention will be more fully 

understood from the detailed description given 
hereinbelow and the attached drawings, which are given 
by way of illustration only and are not to be 

20 considered as limiting the present invention. 

[0033] Further scope of applicability of the 

present invention will become apparent from the 
detailed description given hereinafter. However, it 
should be understood that the detailed description and 

25 specific examples, while indicating preferred 

embodiments of the invention, are given by way of 
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illustration only, since various changes and 
modifications within the spirit and scope of the 
invention will be apparent to those skilled in the art 
from this detailed description. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0034] In the course of the following detailed 

description, reference will be made to the attached 
drawings in which: 

Figl . is a view illustrating the structure of the 
mobile communication system according to an embodiment; 

Fig. 2 is a block diagram illustrating the 
functional structure of a mobile communication terminal 
according to the embodiment; 

Fig 3 is a view illustrating the data flow in the 
mobile communication terminal according to the 
embodiment; 

Fig 4 is a view illustrating the data flow in the 
mobile communication terminal according to the 
embodiment; 

Fig. 5 is a drawing for explanation of the concept 
of the process which is performed by the frame rate 
adjusting section according to the embodiment; 

Fig. 6 is a view illustrating the structure of a 
MP4 file according to the embodiment; 

Fig. 7 is a view illustrating the structure of a 
MP4 file according to the embodiment; 



Fig. 8 is a block diagram illustrating the 
functional structure of a mobile communication terminal 
according to the embodiment; 

Fig. 9 is a block diagram illustrating the 
functional structure of the video generating server 
according to the embodiment; 

Fig. 10 is a block diagram illustrating the 
functional structure of a mobile communication terminal 
according to the embodiment; 

Fig. 11 is a view illustrating an example of a 
picture being displayed by the playback section 
according to the embodiment and an example of a picture 
being displayed by the map display section according to 
the embodiment; 

Fig. 12 is a view illustrating an example of a 
picture being displayed by the playback section 
according to the embodiment; 

Fig. 13 is a block diagram illustrating the 
functional structure of a mobile communication terminal 
according to the embodiment; 

Fig. 14 is a block diagram illustrating the 
functional structure of a mobile communication terminal 
according to the embodiment; 

Fig. 15 is a flow chart illustrating the video 
file generating operation of the mobile communication 
terminal according to the embodiment; 



Fig. 16 is a flow chart of the frame rate 
adjusting process shown in Fig. 15; 

Fig. 17 is a flow chart illustrating the video 
file generating operation of the mobile communication 
5 terminal according to the embodiment; 

Fig. 18 is a flow chart illustrating the video 
file playback operation of the mobile communication 
terminal according to the embodiment; 

Fig. 19 is a view illustrating the structure of 
10 the video generating program according to the 

embodiment; 

Fig. 20 is a view illustrating the structure of 
the video generating program according to the 
embodiment; 

15 Fig. 21 is a view illustrating the structure of 

the video playback program according to the embodiment; 

Fig. 22 is a view illustrating the structure of 

the video generating and playback program according to 

the embodiment ; and 
20 Fig. 23 is a view illustrating the structure of 

the video generating and playback program according to 

the embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0035] A mobile communication system 1 according 

25 to an embodiment of the present invention will now be 

explained with reference to the accompanying drawings. 
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In the description hereinafter, identical or equivalent 
portions will be denoted by the same reference symbols 
throughout the drawings, for easier understanding of 
the description. 

[0036] Fig.l is a view illustrating the structure 

of the mobile communication system according to an 
embodiment. The mobile communication system 1 shown in 
Fig. 1 according to this embodiment includes a mobile 
communication terminal 4, a mobile communication 
terminal 6, a mobile communication terminal 8, a mobile 
communication terminal 10, a mobile communication 
terminal 12, a mail server 14, a video generating 
server 16 and a video registration server 18. The 
mobile communication terminal 4, the mobile 
communication terminal 6, the mobile communication 
terminal 8, the mobile communication terminal 10, the 
mobile communication terminal 12, the mail server 14, 
the video generating server 16 and the video 
registration server 18 are each connected to a mobile 
communication network 2 . 

[0037] Next, the mobile communication terminal 4 

will now be explained. The mobile communication 
terminal 4 is an information communication terminal, 
such as a cellular phone, which is carried by a user. 
The mobile communication terminal 4 physically includes 
a CPU (central processing unit) , a storage device, a 
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display device such as a display, and an input device 
such as push buttons, a communication device, a camera 
and the like. 

[0038] Fig. 2 is a block diagram illustrating the 

5 functional structure of the mobile communication 

terminal 4. The mobile communication terminal 4 
functionally includes a photographing section 
(photographing means) 20, a position detecting section 
(position information acquiring means) 22, a position 

10 information assigning section (position information 

assigning means) 24, a temporary storage section 26, a 
frame rate adjusting section (frame rate adjusting 
means) 28, a video generating section (video generating 
means) 30, a storage section (storage means) 32, and a 

15 radio-communication section (transmitting means) 34. 

[0039] The photographing section 20 acquires 

images of field, at current positions of the mobile 
communication terminal 4. The photographing section 20 
carries out this function with a camera provided on the 

20 above-described mobile communication terminal 4. Figs 

3 and 4 are views illustrating the data flow in the 
mobile communication terminal 4. As illustrated in 
Fig. 3, the photographing section 20 acquires images at 
current positions of the mobile communication terminal 

25 4, while being carried by a user of the mobile 

communication terminal 4 (reference numeral 36) . The 
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photographing section 20 acquires images at a rate of 
30 frames per second. 

[0040] The position detecting section 22 acquires 

items of position information concerning current 
positions of the mobile communication terminal 4. Such 
position information can be acquired through GPS 

(Global Positioning System) and includes latitude and 
longitude information acquired by GPS (Global 
Positioning System) , as represented by the reference 
numeral 38 in Fig. 3, The position detecting section 22 
acquires position information, for example, at a rate 
of 15 times per second. 

[0041] Returning to Fig. 2, the position 

information assigning section 24 associates each 
images, which are acquired by the photographing section 
20 at a predetermined time interval, with position 
information concerning the position at which the image 
is acquired. The position information which is 

associated with the image acquired by the photographing 
section 20 is position information acquired by the 
position detecting section 22. The position 

information assigning section 24 stores the images 
associated with items of the position information in 
the temporary storage section 26. The temporary 
storage section 26 can be realized by a storage device 
such as, for example, RAM (Random Access Memory) . In 
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Fig. 3, the reference numeral 40 represents data 
including the images and the items of position 
information associated therewith by the position 
information assigning section 24. The position 

detecting section 22 and the photographing section 20 
obtain the items of position information and images 
respectively at different rates, and therefore when 
images are acquired at the same time as position 
information, these images can be associated with 
corresponding position information as shown in Fig. 3. 
Also, images may be associated with position 
information acquired at the nearest time. 

[0042] Returning to Fig. 2, the frame rate 

adjusting section 28 determines the frame rate of a 
video to be generated by the video generating section 
30 by the use of images stored in the temporary storage 
section 26, which will be explained later. Fig. 5 is a 
drawing for explanation of the concept of the process, 
which is executed by the frame rate adjusting section 
28. Referring to Fig. 5, the frame rate adjusting 
section 28 divides the plurality of images stored in 
the temporary storage section 2 6 into groups containing 
predetermined number of images. The frame rate 
adjusting section 28 determines a direction 

information with respect to each of the groups. The 
direction information is determined from a travel locus 



based on the items of position information associated 
with images in corresponding group. In fig 5, VI, V2, 
V3, and V4 show each direction information for the 
corresponding groups. The "predetermined number" may 
5 be, for example, the number of images acquired per 10 

seconds . 

[0043] The frame rate adjusting section 28 

calculates an angle between a vector base on the 
direction information determined for the processing 

10 target group and a vector base on the direction 

information determined for the next group. When the 
angle is equal to or less than a predetermined angle, 
the frame rate adjusting section 2 8 determines the 
direction change for the processing target group is 

15 small. The "predetermined angle" may be 45 degree, for 

example. When the frame rate adjusting section 28 
determines that the direction change for the processing 
target group is small, it sets the frame rate for a 
video generated from the images included in the 

20 processing target group to a low value. In the example 

shown in Fig. 5, the vector of direction information VI 
of the first 10 ■ seconds and the vector of direction 
information V2 of the next 10 seconds form an angle of 
more than 45 degree, and therefore the frame rate 

25 adjusting section 28 determines that the direction 

change is large and sets the frame rate for the group 
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corresponding to the direction information VI to a high 
value- This high value may be, for example, 15 frames 
per second, as represented by the reference numeral 42 
in Fig. 4. 

[0044] Returning to Fig. 5, next, since the vector 

of direction information V2 and the vector of direction 
information V3 of the next 10 seconds form an angle of 
less than 45 degree, the frame rate adjusting section 
28 determines that the direction change is small. 
However, since the frame rate adjusting section 28 has 
determined that the previous direction change is large, 
it sets a high frame rate for the group corresponding 
to the direction information V2 . Next, the vector of 
direction information V3 and the vector of the 
direction information V4, indicated by the solid line, 
of the next 10 seconds form an angle of the direction 
change is of more than 45 degree, and therefore the 
frame rate adjusting section 28 determines that the 
direction change is large and sets a high frame rate 
for the group corresponding to the direction 
information V3 . On the other hand, in the case of the 
direction information V4 indicated by the broken line, 
the vector of direction information V3 and the vector 
of direction information V4 form an angle equal to or 
less than 45 degree, and the frame rate adjusting 
section 28 judges that the direction change is small. 



Also, the previous direction change is small, and 
therefore the frame rate adjusting section 28 sets a 
low frame rate for the group corresponding to the 
direction information V3 . This low frame rate may be, 
for example, 1 frame per second, as represented by the 
reference numeral 44 in Fig. 4. 

[0045] Returning to Fig. 2, the video generating 

section 30 generates a video using a plurality of 
images being stored in the temporary storage section 
26. The frame rate of the video is set according to 
the frame rates determined by the frame rate adjusting 
section 28. The video generating section 30 associates 
each of the frames of the video with the position 
information concerning the position where the frame is 
acquired. Among the items of position information 
associated with the respective images stored in the 
temporary storage section 26, the position information 
associated with the images which correspond to the 
respective frames of the above video is associated with 
the frames of the video. The video generating section 
30 generates a video file using the generated video and 
the position information associated with the respective 
frames thereof, and stores the video file in the 
storage section 32. The storage section 32 is 

constructed in a storage device of the mobile 
communication terminal 4 . 
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[0046] As such a video file, a video file in the 

form of MPEG-4 file, for example, may be used as 
represented by the reference numeral 4 6 in Fig. 4. 
Fig. 6 is a view illustrating the structure of a MP4 
file, which is one type of MPEG-4 file. A MP4 file is 
comprised of a "moov" header area, called atom, in 
which header information is stored and a "mdat" area in 
which video data, audio data and the like is stored. 
In this embodiment, by extending a conventional MP4 
file, location information including frame numbers of 
the video and the above-described position information 
associated with the respective frame numbers can be 
stored in the "mdat" area, and a track (location) 
section indicating the area in which the location 
information has been stored can be constructed in the 
"moov" header area. Note that, as illustrated in Fig. 7 
representing another MP4 file structure, the above- 
described location information may be stored in the 
"moov" header area. 

[0047] Returning to Fig. 2, the radio communication 

section 34 transmits the video file stored in the 
storage section 32 to the video registration server 18 
which will be explained later or other mobile 
communication terminals. 

[0048] Next, the mobile communication terminal 6 

will now be explained. The mobile communication 



terminal 6 is an information communication terminal, 
such as a cellular phone, which is carried by a user. 
The physical structure of the mobile communication 
terminal 6 is similar to that of the mobile 
communication terminal 4 . 

[0049] Fig. 8 is a block diagram illustrating the 

functional structure of the mobile communication 
terminal 6. The mobile communication terminal 8 
functionally includes a photographing section 

(photographing means) 20, a position detecting section 

(position information acquiring means) 22, a position 
information assigning section (position information 
assigning means) 24, a temporary storage section 26, a 
video generating section (video generating means) 48, a 
radio-communication section (a second transmitting 
means and receiving means) 50 and a storage section 

(storage means) 52. 

[0050] The photographing section 20 has a 

structure similar to that of the photographing section 
20 of the mobile communication terminal 4 and acquires 
images of field at current positions of the mobile 
communication terminal 6. The position detecting 
section 22 has a structure similar to that of the 
position detecting section ' 22 of the mobile 
communication terminal 4 and acquires position 
information concerning current position of the mobile 



communication terminal 6. 

[0051] The position information assigning section 

24 has a structure similar to that of the position 
information assigning section 24 of the mobile 
communication terminal 4, and associates images 
acquired by the photographing section 20 with position 
information concerning the respective positions where 
the images are acquired and stores these images and the 
items of position information in the temporary storage 
section 26. 

[0052] The video generating section 48 generates a 

video composed of a plurality of frames, each of which 
is an image stored in the temporary storage section 26. 
Each of the frames of the video is associated with the 
position information concerning the position where it 
is acquired. Among the items of position information 
associated with the images stored in the temporary 
storage section 26, the position information associated 
with the images, which correspond to the respective 
frames of the above video, is associated with the 
frames of the video. The video generating section 48 
generates a video file by using the generated video and 
the items of position information associated, with the 
respective frames of the video. As such a video file, 
for example, a MP4 file having the same structure as a 
MP4 file generated by the video generating section 30 
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of the mobile communication terminal 4 may be used 
[0053] The radio communication section 50 

transmits the video file generated by the video 
generating section 4 8 to the video generating server 
16. The radio communication section 50 can transmit 
the video file in accordance with a videophone 
protocol, for example. After receiving the video file, 
the generating server 16 adjusts the frame rate of the 
video as will explained later. The radio communication 
section 50 receives the video file including the video 
having frame rates set by the video generating server 
16, and stores the video file in the storage section 
52. The radio communication section 50 transmits the 
video file stored in the storage section 52 to the 
video registration server 18 or other mobile 
communication terminals . 

[0054] Nest, the video generating server 16 will 

now be explained. The video generating server 16 
adjusts the frame rate of the video in a video file 
transmitted from a mobile communication terminal. 
After adjusting the frame rate, the video generating 
server 16 sends back the video file including the video 
having adjusted frame rates, to the mobile 
communication terminal. The video generating server 16 
is physically a computer system comprising a CPU 
(central processing unit) , a storage device such as a 
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storage, a storage device such as a hard disk, a 
communication device and other components. 
[0055] Fig. 9 is a block diagram illustrating the 

functional structure of the video generating server 16. 
5 In functional term, the video generating server 16 

comprises a communication section 54, a decoding 
section 56, a frame rate adjusting section 58, a video 
generating section 60 and a storage section 62. 
[0056] The communication section 54 receives a 

10 video file transmitted from a mobile communication 

terminal. The communication section 54 also sends back 
to this mobile communication terminal the video file 
including the video having adjusted frame rates, as 
will be explained later. 

15 [0057] The decoding section 56 decodes the video 

file, which the communication section 54 received. The 
frame rate adjusting section 58 adjusts the frame rate 
of the decoded video. This frame rate adjustment is 
similar to that which is executed by the frame rate 

20 adjusting section 28 of the mobile communication 

terminal 4 . 

[0058] The video generating section 60 generates a 

video file by using the video the frame rate of which 
has been adjusted by the frame rate adjusting section 
25 58 and the items of position information associated 

with the respective frames of this video. Then, the 
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video generating section 60 stores the video file in 
the storage section 62. This video file has a 
structure similar to that of a video file generated by 
the video generating section 30 of the mobile 
communication terminal 4. As described above, the 
communication section 54 sends back the video file 
stored in the storage section 62 to the mobile 
communication terminal. 

[0059] Next, the mobile communication terminal 8 

will now be explained. The mobile communication 
terminal 8 receives a video file transmitted from the 
mobile communication terminal 4 or 6 or a video file 
registered in the video registration server 18, and 
then displays a video included in this video file. The 
mobile communication terminal 8 has a physical 
structure similar to that of the mobile communication 
terminal 4 . 

[0060] Fig. 10 is a block diagram illustrating the 

functional structure of the mobile communication 
terminal 8. The mobile communication terminal 8 
functionally comprises a radio communication section 
(receiving means) 64, a storage section 66, a position 
detecting section (position information acquiring 
means) 68, a video searching section (searching means), 
a playback section (playback means) 72, a map display 
section (map display means) 74 and a display changeover 
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section 76. 

[0061] The radio communication section 64 receives 

the above-described video file transmitted from another 
mobile communication terminal such as the mobile 
communication terminal 4 or the mobile communication 
terminal 6. The radio communication section 64 stores 
received video file in the storage section 66. 
[0062] The position detecting section 68 is 

structured similarly to the position detecting section 
22 of the mobile communication terminal 4 and acquires 
position information concerning current position of the 
mobile communication terminal 8. 

[0063] The video searching section 70 compares the 

position information acquired by the position detecting 
section 68 with the position information associated 
with each of the frames of the video in the video files 
stored in the storage section 66, and specifies the 
frame associated with the position information which is 
closest to the position information acquired by the 
position detecting section 68. 

[0064] The playback section 72 displays the frame 

specified by the video searching section 70, on the 
display device of the mobile communication terminal 8. 
The playback section 72 can also display a video in a 
playback file selected by a user of the mobile 
communication terminal 8, among the video files stored 



in the storage section 66. The playback section 72 
also refers to the position information associated with 
each of the frames of the above video and superimposes, 
on a frame currently being displayed, a predetermined 
symbol indicating the direction of the route to the 
positions at which frame to be displayed later than the 
current frame are acquired. 

[0065] The map display section 74 displays two- 

dimensional map information on the display device of 
the mobile communication terminal 8. The map display 
section 74 can obtain two-dimensional map information, 
for example, by making an access request to a server 
where two-dimensional information has been registered. 
The map display section 74 displays, on two-dimensional 
map information being displayed, a travel locus based 
on the items of position information associated with 
respective frames of the video being displayed by the 
playback section 72. 

[0066] The display changeover section 76 switches 

the mode of display on the display device, between the 
mode of display which is provided by the playback 
section 72 and the mode of display, which is provided 
by the map display section 74. A user of the mobile 
communication terminal 8 selects the mode of display on 
the display device. The display changeover section 7 6 
can also provide both the mode of display provided by 
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the playback section 72 and the mode of display 
provided by the map display section 72 simultaneously 
on the display device by splitting the screen of the 
display device. Fig. 11 illustrates an example of 
picture on the screen of the display device which is 
provided by the playback section 72 and an example of 
display on the screen, which is provided by the map 
display section 74. The reference numeral 78 in Fig. 11 
designates an example of a frame being displayed on the 
screen by the playback section 72 and the reference 
numeral 80 designates an example of a frame being 
displayed on the screen by the map display section 74. 
As shown in Fig. 11, a travel locus based on the items 
of position information associated with the frames 
displayed by the playback section 72 is displayed on 
the two-dimensional map displayed by the map display 
section 74. Fig. 12 illustrates an example of a picture 
being displayed on the screen by the playback section 
72. When displaying a frame of a scene around an 
intersection, the playback section 72 refers to the 
position information associated with frames of the 
video and if the position information associated with 
frames to be displayed later indicates positions lying 
in the direction of the other street intersecting at 
the intersection, displays a symbol indicating the 
route to the positions, as shown in Fig. 12. 



[0067] Next, the mobile communication terminal 10 

will now be explained . The mobile communication 
terminal 10 is an information communication terminal, 
such as a cellular phone, which is carried by a user. 
5 The mobile communication terminal 10 has a physical 

structure similar to that of the mobile communication 
terminal 4 . 

[0068] Fig. 13 is a block diagram illustrating the 

functional structure of the mobile communication 

10 terminal 10. The mobile communication terminal 10 

functionally includes a photographing section 
(photographing means) 20, a position detecting section 
(position information acquiring means) 22, a position 
information assigning section (position information 

15 assigning means) 24, a temporary storage section 26, a 

frame rate adjusting section (frame rate adjusting 
means) 28, a video generating section (video generating 
means) 30, a storage section (storage means) 32, a 
video searching section (searching means) 70, a playback 

20 section (playback means) 72, a map display section (map 

display means) 74, a display changeover section 76 and 
a radio-communication section 82. 

[0069] The photographing section 20 is structured 

similarly to the photographing section 20 of the mobile 
25 communication terminal 4 and acquires images of field 

at current positions of the mobile communication 
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terminal 6. The position detecting section 22 is 
structured similarly to the position detecting section 
22 of the mobile communication terminal 4 and acquires 
position information concerning current position of the 
mobile communication terminal 10. The position 

information assigning section 24, the temporary storage 
section 26, the frame rate adjusting section 28, the 
video generating section 30 and the storage section 32 
are structured similarly to the position information 
assigning section 24, the temporary storage section 26, 
the frame rate adjusting section 28, the video 
generating section 30 and the storage section 32, 
respectively, of the mobile communication terminal 4. 
The video searching section 70, the playback section 
72, the map display section 74 and the display 
changeover section 76 are structured similarly to the 
video searching section 70, the playback section 72, 
the map display section 7 4 and the display changeover 
section 76, respectively, of the mobile communication 
terminal 8. The video searching section 70, the 
playback section 72 and the map display section 74 
access a video file stored in the storage section 32. 
[0070] The radio-communication section 82 

transmits the video file stored in the storage section 
32 to other mobile communication terminals or the video 
registration server 18. The radio-communication 



section 82 can also receives a video file transmitted 
from other mobile communication terminals or a video 
file registered in the registration server 18, and 
stores them in the storage section 32. 

[0071] Next, the mobile communication terminal 12 

will now be explained. The mobile communication 
terminal 12 is an information communication terminal, 
such as a cellular phone, which is carried, by a user. 
The mobile communication terminal 12 physically 
comprises the same components as the mobile 
communication terminal 4 . 

[0072] Fig. 14 is a block view illustrating the 

functional structure of the mobile communication 
terminal 12. The mobile communication terminal 12 
functionally includes a photographing section 
(photographing means) 20, a position detecting section 
(position information acquiring means) 22, a position 
information assigning section (position information 
assigning means) 24, a temporary storage section 26, a 
video generating section (video generating means) 48, a 
radio-communication section (a second transmitting 
means and receiving means) 50, a storage section 
(storage means) 52, a video searching section 
(searching means) 70, a playback section (playback 
means) 72, a map display section (map display means) 74 
and a display changeover section 76. 



[0073] The photographing section 20 has a 

structure similar to that of the photographing section 
2 0 of the mobile communication terminal 4, and acquires 
images of field at current positions of the mobile 
communication terminal 12. The position detecting 
section 22 has a structure similar to that of the 
photographing section 20 of the mobile communication 
terminal 4 and acquires position information concerning 
current position of the mobile communication terminal 
12. The position information assigning section 24, the 
temporary storage section 2 6, the video generating 
section 48, the radio-communication section 50, the 
storage section 52 are structured similarly to the 
position information assigning section 24, the 
temporary storage section 26, the video generating 
section 48, the radio-communication section 50, the 
storage section 52, respectively, of the mobile 
communication terminal 6. The video searching section 
70, the playback section 72, the map display section 74 
and the display changeover section 76 are structured 
similarly to the video searching section 70, the 
playback section 72, the map display section 74 and the 
display changeover section 76, respectively, of the 
mobile communication terminal 8. The video searching 
section 70, the playback section 72 and the map display 
section 74 access a video file stored in the storage 



section 52. The radio-communication section 50 may 
also transmit the video file stored in the storage 
section 52 to other mobile communication terminals or 
the video registration server 18. The radio- 

communication section 50 may also receive a video file 
transmitted from other mobile communication terminals 
or a video file registered in the registration server 
18, and may store them in the storage section 32. 
[0074] Next, the mail server 14 and the video 

registration server 18 will now be explained. The mail 
server 14 and the video registration server 18 
physically comprise a CPU (central processing unit) , a 
storage device such as a storage, a storage device such 
as a hard disk, a communication device and other 
components. The mail server 14 receives mails and a 
video file attached thereto, transmitted from the 
above-described mobile communication terminals, and 
transfers them to other mobile communication terminals 
which are the destinations of the mails. The video 
registration server 18 registers and publicizes a video 
file generated by the above-described mobile 
communication terminals. The video registration server 
18, in response to an access request for a video file 
from a mobile communication terminal, transmits the 
video file to this mobile communication, terminal . 
[0075] Hereinafter, the operation of the mobile 
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communication system 1 according to the present 
embodiment will be explained* At first, the video file 
generating operation of the mobile communication 
terminals 4 and 10 will be explained. Fig. 15 is a flow 
chart illustrating the video file generating operation 
of the mobile communication terminals 4 and 10. Fig. 16 
is a flow chart of the frame rate adjusting process in 
the flow chart of Fig. 15. 

[0076] As illustrated in Fig. 15, in the mobile 

communication terminals 4 and 10, the photographing 
section 20 acquires images of field (step S01) . In 
parallel with this, the position detecting section 22 
acquires position information (step S02) . Then, the 
position information assigning section 24 associates 
each of the images with the position information 
concerning the position where the image is acquired, 
and stores the images along with the items of position 
information in the temporary storage section 26 (step 
S03) . Next, the frame rate adjusting section 28 
executes the frame rate adjusting process for 
determining the frame rate of the video to be generated 
from a plurality of images being stored in the 
temporary storage section 26 (step S04) . 

[0077] In the frame rate adjusting process, at 

first, a direction change flag is set to OFF as 
illustrated in Fig. 16 (step S05) . This direction 



change flag is a flag for storing, in the case where 
the frame rate adjusting section 28 has determined that 
the previous direction change is large, the result of 
the determination. At the initial state, the direction 
change flag is set to OFF. 

[007 8] Then, among the images acguired during the 

10 seconds from starting time of photographing, the 
frame rate adjusting section 28 acquires the position 
information associated with the first acquired image 
and the position information associated with the last 
acquired image, from the temporary storage section 26. 
Further, for the images acquired within the next 10 
seconds, the frame rate adjusting section 28 also 
acquires the position information associated with the 
first acquired image and the position information 
associated with the last acquired image, from the 
temporary storage section 26 (step S06) . Then, based 
on the two pieces of position information for each 10 
seconds period, the frame rate adjusting section 28 
derives two pieces of direction information (step S07) . 
[0079] Next, the angle between the two direction 

vectors based on the two pieces of direction 
information is calculated. Then, it is determined 
whether the direction change is large by determining 
whether the angle is larger than a predetermined angle, 
or it is determined whether the direction change flag 
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has been set to ON (step S08) . In the case where at 
least one of these two conditions is satisfied, the 
frame rate adjusting section 28 sets the frame rate to 
a high value (step S09) , and sets the direction change 
flag to ON (step S10) . On the other hand, if any of 
these two conditions are not satisfied, the frame rate 
adjusting section 28 set the frame rate to a low value 
(step Sll) , and sets the direction change flag to OFF 
(step S12) . Then, it is determined whether there is 
still any data to be processed in the temporary storage 
section 26 (step S13) . If there is data, the frame 
rate adjusting section 28 acquires the position 
information associated with the first acquired image 
and the position information associated with the last 
acquired image, for the images acquired within the next 
10 seconds (step S14), and continues the process from 
step S07. On the other hand, if there is no data to be 
processed in the temporary storage section 26, the 
frame rate adjusting process ends. 

[0080] Returning to Fig. 15, the video generating 

section 30 generates a video according to the frame 
rates determined by the frame rate adjusting section 
28, and then generates a video file including the video 
and the position information associated with its frames 

(Step S15) . 

[0081] Next, the video file generating operation 
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of the mobile communication terminals 6, 12 will be 
explained. Fig. 17 is a flow chart illustrating the 
video file generating operation of the mobile 
communication terminals 6 and 12. As illustrated in 
Fig. 17, in the mobile communication terminals 6 and 12, 
the photographing section 20 acquires images of field 
(step S21) . In parallel with this, the position 
detecting section 22 acquires position information 
(step S22) . Then, the position information assigning 
section 24 associates each of the images with the 
position information concerning the position where the 
image is acquired, and stores the images along with the 
items of position information in the temporary storage 
section 26 (step S23) . 

[0082] Next, the video generating section 48 

generates the video file using a plurality of images 
stored in the temporary storage section 26 (step S24). 
This video file is transmitted to the video generating 
server 16 by the radio-communication section 50 (step 
S25) . The video generating server 16 adjusts the frame 
rate of the image file in the video file (step S26) and 
regenerates the video as a video file (step S27) . The 
frame rate adjusting process of the video generating 
server 16 is similar to that of the frame rate 
adjusting section 28 of the mobile communication 
terminal 4. Then, the video generating server 16 
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transmits the video file generated as described above, 
to the radio-communication section 50. The radio- 
communication section 50 stores it in the storage 
section 52 (step S28) . 

[0083] Next, the video file playback operation of 

the mobile communication terminals 8, 10, and 12 will 
be explained. Fig. 18 is a flow chart illustrating the 
video file playback operation of the mobile 
communication terminals 8, 10 and 12. The explanation 
of the operation will be given on the basis of the 
assumption that there has been stored a video file in 
the storage sections of the mobile communication 
terminals 8, 10 and 12. 

[0084] As illustrated in Fig. 18, at first, the 

position detecting section acquires position 
information (step S31) . Then, the video searching 
section 70 specifies, among the items of position 
information associated with the respective frames of 
the video in the video file stored in the storage 
section, the position information closest to the 
position information acquired by the position detecting 
section and then specifies the frame associated with 
the specified position information. The playback 
section 74 displays the specified frame (step S32) . In 
parallel with this, the map display section 74 displays 
two-dimensional map information and a travel locus 
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superimposed thereon, which is based on the items of 
position information associated with the frames being 
displayed (step S33) . Then, it is determined whether 
there is still any frame to be displayed by the 
playback section 72 (step S34) . If there is no frame 
to be displayed by the playback section 72, this 
process ends. On the other hand, if there is still a 
frame to be displayed, the process proceeds from step 
S31. 

[0085] Next, the video generating program 100 for 

operating a mobile communication terminal as the mobile 
communication terminal 4 according to the present 
embodiment will now be explained. Fig. 19 is a view 
illustrating the structure of the video generating 
program 100. The video generating program 100 

comprises a main module 102 for controlling the overall 
process, a photographing module 104, a position 
detecting module 106, a position information assigning 
module 108, a frame rate adjusting module 110, a video 
generating module 112, a radio-communication module 
114. The video generating program 100 is provided, for 
example, by recording media such as CD-ROM, DVD, ROM, 
etc., or by semiconductor memories. The video 

generating program 100 may be a program provided as 
computer data signals over a carrier wave through a 
network. Functions that the photographing module 104, 
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the position detecting module 106, the position 
information assigning module 108, the frame rate 
adjusting module 110, the video generating module 112 
and the radio-communication module 114 make a computer 
execute are the same as those of the above-mentioned 
photographing section 20, position detecting section 
22, position information assigning section 24, frame 
rate adjusting section 28, video generating section 30 
and radio-communication section 34, respectively, of 
the above-described mobile communication terminal 4. 
[0086] Next, the video generating program 120 for 

operating a mobile communication terminal as the mobile 
communication terminal 6 according to the present 
embodiment will now be explained. Fig. 20 is a view 
illustrating the structure of the video generating 
program 120. The video generating program 120 

comprises a main module 122 for controlling the overall 
process, a photographing module 124, a position 
detecting module 126, a position information assigning 
module 12 8, a video generating module 130 and a radio- 
communication module 132. The video generating program 
120 is provided, for example, by recording media such 
as CD-ROM, DVD, ROM, etc., or by semiconductor 
memories. The video generating program 120 may be a 
program provided as computer data signals over a 
carrier wave through a network. Functions that the 
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photographing module 124, the position detecting module 
126, the position information assigning module 128, the 
video generating module 130 and the radio-communication 
module 132 make a computer execute are the same as 
those of the above-mentioned photographing section 20, 
position detecting section 22, position information 
assigning section 24, frame rate adjusting section 28, 
video generating section 48 and radio-communication 
section 50, respectively, of the above-described mobile 
communication terminal 6. 

[0087] Next, the video playback program 140 for 

operating a mobile communication terminal as the mobile 
communication terminal 8 according to the present 
embodiment will now be explained. Fig. 21 is a view 
illustrating the structure of the video playback 
program 140. The video playback program 140 comprises 
a main module 142 for controlling the overall process, 
a radio-communication module 144, a position detecting 
module 146, a video searching module 148, a playback 
module 150, a map display module 152 and a display 
changeover module 154. The video playback program 140 
is provided, for example, by recording media such as 
CD-ROM, DVD, ROM, etc., or by semiconductor memories. 
The video playback program 14 0 may be a program 
provided as computer data signals over a carrier wave 
through a network. Functions that the radio- 
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communication module 144, the position detecting module 
146, the video searching module 148, the playback 
module 150, the map display module 152 and the display 
changeover module 154 make a computer execute are the 
same as those of the above-mentioned radio- 
communication section 64, position detecting section 
68, video searching section 70, playback section 72, 
map display section 74 and display changeover section 
76, respectively, of the above-described mobile 
communication terminal 8. 

[0088] Next, the video generating and playback 

program 160 for operating a mobile communication 
terminal as the mobile communication terminal 10 
according to the present embodiment will now be 
explained* Fig. 22 is a view illustrating the 

structure of the video generating and playback program 
160. The video generating and playback program 160 
comprises a main module 162 for controlling the overall 
process, a photographing module 164, a position 
detecting module 166, a position information assigning 
module 168, a frame rate adjusting module 170, a video 
generating module 172, a radio-communication module 
174, a video searching module 176, a playback module 
178, a map display module 180 and a display changeover 
module 182*. The video generating and playback program 
160 is provided, for example, by recording media such 
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as CD-ROM, DVD, ROM, etc, or by semiconductor 
memories. The video generating and playback program 
160 may be a program provided as computer data signals 
over a carrier wave through a network. Functions that 
the photographing module 164, the position detecting 
module 166, the position information assigning module 
168, the frame rate adjusting section 170, the video 
generating module 172, the radio-communication module 
174, the video searching module 176, the playback 
module 178, the map display module 180 and the display 
changeover module 182 make a computer execute are the 
same as those of the above-mentioned photographing 
section 20, position detecting section 22, position 
information assigning section 24, frame rate adjusting 
section 28, video generating section 30, radio- 
communication section 82, video searching section 70, 
playback section 72, map display section 74 and display 
changeover section 76, respectively, of the above- 
described mobile communication terminal 10. 
[008 9] Next, the video generating and playback 

program 200 for operating a mobile communication 
terminal as the mobile communication terminal 12 of the 
present embodiment will now be explained. Fig. 23 is a 
view illustrating the structure of the video generating 
and playback program 200. The video generating and 
playback program 200 comprises a main module 202 for 
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controlling the overall process, a photographing module 
204, a position detecting module 206, a position 
information assigning module 208, a video generating 
module 210, a radio-communication module 212, a video 
searching module 214, a playback module 216, a map 
display module 218 and a display changeover module 220. 
The video generating and playback program 200 is 
provided, for example, by recording media such as CD- 
ROM, DVD, ROM, etc., or by semiconductor memories. The 
video generating and playback program 200 may be a 
program provided as computer data signals over a 
carrier wave through a network. Functions that the 
photographing module 204, the position detecting module 
206, the position information assigning module 208, the 
15 video generating module 210, the radio-communication 

module 212, the video searching module 214, the 
playback module 216, the map display module 218 and the 
display changeover module 220 make a computer execute 
are the same as those of the above-mentioned 
photographing section 20, position detecting section 
22, position information assigning section 24, video 
generating section 48, radio-communication section 50, 
video searching section 70, playback section 72, map 
display section 74 and display changeover section 76, 
respectively, of the above-described mobile 
communication terminal 12. 
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[0090] Hereinafter, the actions and effects of the 

mobile communication system 1 according to the present 
embodiment will now be explained. In the mobile 
communication terminals 4, 6, 10 and 12, the 
photographing section 20 acquires images in a 
predetermined time interval, and the position 
information assigning section 24 associates each images 
with the position information concerning the position 
at which the image is acquired. The video generating 
section generates, by using a plurality of images 
associated with the corresponding position information, 
a video including frames each associated with the 
position information concerning the position at which 
the frame is acquired. Accordingly, the video 
generating section generates a video including frames 
each associated with the position information, which is 
little deviated from the position at which the frame is 
acquired. These mobile communication terminals allow 
for storing a video of desired routes, for example, 
instead of generating a map as information about the 
route . 

[0091] In the mobile communication terminals 4 and 

10, the frame rate adjusting section 28 refers to the 
items of position information associated with the 
plurality of images stored in the temporary storage 
section, and if there is no large change in the 
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direction of travel locus around the positions at which 
some images are acquired, sets the frame rates of the 
video to be generated from images taken around these 
positions to a low value. Thus, the mobile 

5 communication terminals 4 and 10 can provide the video 

having a reduced frame rate for sections in which there 
is no large direction change and therefore no large 
change in scenes within the field, thereby having 
reduced capacities. 
10 [0092] In the mobile communication terminals 6 and 

12, a video file generated by the video generating 
section is transmitted to the video generating server 
16. The video generating server 16 refers to the items 
of position information associated with the frames of 
15 the video and if there is no large change in the 

direction of travel locus around the positions at which 
some frames are acquired, reduce the number of frames 
taken around the positions. The mobile communication 
terminals 6 and 12 receive the video with adjusted 
20 frame rates. Thus, the mobile communication terminals 

6 and 12 can obtain the video having a reduced frame 
rate for sections in which there is no large direction 
change and therefore no large change in scenes within 
the field, thereby having reduced capacity. 
25 [0093] In the mobile communication terminals 8, 10 

and 12, the playback section 72 displays a frame 



61 



associated with the position information which is least 
deviated from the position information acquired by the 
position detecting section. Thus, the mobile 

communication terminals 8, 10 and 12 can display, at 
their current positions, a video, which is little 
different from the scenes neighboring their current 
positions. The mobile communication terminals 

according to this embodiment allow a user to walk 
comparing the actual scenes with the scenes of video 
being displayed, while a user of a terminal with a 
conventional navigation function has to check the 
current position only through map information. For 
example, even if there is a deviation between the 
position information acquired through GPS and an actual 
current position, the user can notice the deviation by 
comparing the actual scene with the scenes of video 
being displayed. 

[0094] . Further, in the mobile communication 

terminals 8, 10 and 12, the map display section 74 
displays two-dimensional map information in 
synchronization with frames being displayed by the 
playback section 72 and also displays, on the two- 
dimensional map information, a travel locus based on 
the frames being displayed by the playback section 72. 
Thus, the mobile communication terminals 8, 10 and 12 
can provide information concerning positions on a two- 
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dimensional map and the images of scenes around the 
positions. 

[0095] Further, in the mobile communication 

terminals 8, 10 and 12, the playback section 72 
displays, by superimposing on a video, a predetermined 
symbol indicating the direction of travel, and 
therefore convenient route guidance service can be 
provided to the . user of the mobile communication 
terminal. 

[0096] The preferred embodiments, which have been 

described above, are not intended to limit the present 
invention, and it should be understood that various 
modifications might be made. For example, while the 
mobile communication terminals according to the above- 
described embodiments 4, 6, 10 and 12 generate a video 
with a maximum frame rate of 15 frames per second and 
these frames are all associated with position 
information, the number of frames may be reduced such 
that only one frame in each 0.1 second time interval is 
associated with position information. 

[0097] The principles of the present invention 

have been illustrated and described in the preferred 
embodiments, but it is apparent to a person skilled in 
the art that the present invention can be modified in 
arrangement and detail without departing from such 
principles. We, therefore, claim rights to all 
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variations and modifications coming with the spirit and 
the scope of claims. 
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